• An Introduction to Stochastic Processes, by Edward P. C. Kao, Dover 2019, Duxbury Press, 1997; ISBN 9780486837925
• An Introduction to Probability with Mathematica, by Edward P. C. Kao, World Scientific, May 2022; ISBN: 9789811246784

Catalog Description: We study the theory and applications of stochastic processes. Topics include discrete-time and continuous-time Markov chains, Poisson process, branching process, Brownian motion. Considerable emphasis will be given to applications and examples.

Instructor's description: This course provides a overview of stochastic processes. We cover Poisson processes, discrete-time and continuous-time Markov chains, renewal processes, diffusion process and its variants, marttingales. We also study Markov chain Monte Carlo methods, and regenerative processes. In addition to covering basic theories, we also explore applications in various areas such as mathematical finance.

Syllabus can be found here: https://www.math.uh.edu/~edkao/MyWeb/doc/math4320_fall2022_syllabus.pdf

While lecture notes will serve as the main source of material for the course, the following book constitutes a great reference:
”An Introduction to Statistical Learning (with applications in R)” by James, Witten et al. ISBN: 978-1461471370
”Neural Networks with R” by G. Ciaburro. ISBN: 978-1788397872

Course will deal with theory and applications for such statistical learning techniques as linear and logistic regression, classification and regression trees, random forests, neural networks. Other topics might include: fit quality assessment, model validation, resampling methods. R Statistical programming will be used throughout the course.

Learning Objectives: By the end of the course a successful student should:

• Have a solid conceptual grasp on the described statistical learning methods.
• Be able to correctly identify the appropriate techniques to deal with particular data sets.
• Have a working knowledge of R programming software in order to apply those techniques and subse- quently assess the quality of fitted models.
• Demonstrate the ability to clearly communicate the results of applying selected statistical learning methods to the data.

Software: Make sure to download R and RStudio (which can’t be installed without R) before the course starts. Use the link https://www.rstudio.com/products/rstudio/download/ to download it from the mirror appropriate for your platform. Let me know via email in case you encounter difficulties.

Course Outline:
Introduction: What is Statistical Learning?

Supervised and unsupervised learning. Regression and classification.
Linear and Logistic Regression. Continuous response: simple and multiple linear regression. Binary response: logistic regression. Assessing quality of fit.
Model Validation. Validation set approach. Cross-validation.
Tree-based Models. Decision and regression trees: splitting algorithm, tree pruning. Random forests: bootstrap, bagging, random splitting.
Neural Networks. Single-layer perceptron: neuron model, learning weights. Multi-Layer Perceptron: backpropagation, multi-class discrimination

Intro to Statistical Learning. ISBN: 9781461471370

This first course in the sequence Math 4331-4332 provides a solid introduction to deeper properties of the real numbers, continuous functions, differentiability and integration needed for advanced study in mathematics, science and engineering. It is assumed that the student is familiar with the material of Math 3333, including an introduction to the real numbers, basic properties of continuous and differentiable functions on the real line, and an ability to do epsilon-delta proofs.

Topics: Open and closed sets, compact and connected sets, convergence of sequences, Cauchy sequences and completeness, properties of continuous functions, fixed points and the contraction mapping principle, differentiation and integration.

MATH 3331 or equivalent, and three additional hours of 3000-4000 level Mathematics. Previous exposure to Partial Differential Equations (Math 3363) is recommended.

"Partial Differential Equations: An Introduction (second edition)," by Walter A. Strauss, published by Wiley, ISBN-13 978-0470-05456-7  

Description:Initial and boundary value problems, waves and diffusions, reflections, boundary values, Fourier series.

Instructor's Description: will cover the first 6 chapters of the textbook. See the departmental course description.

MATH 3349

- Applied Multivariate Statistical Analysis (6th Edition), Pearson. Richard A. Johnson, Dean W. Wichern. ISBN: 978-0131877153 (Required)

- Using R With Multivariate Statistics (1st Edition). Schumacker, R. E. SAGE Publications. ISBN: 978-1483377964 (recommended)

Course Description: Multivariate analysis is a set of techniques used for analysis of data sets that contain more than one variable, and the techniques are especially valuable when working with correlated variables. The techniques provide a method for information extraction, regression, or classification. This includes applications of data sets using statistical software.

Course Objectives:

• Understand how to use R and R Markdown
• Understand matrix algebra using R
• Understand the geometry of a sample and random sampling
• Understand the properties of multivariate normal distribution
• Make inferences about a mean vector
• Compare several multivariate means
• Identify and interpret multivariate linear regression models

Course Topics:

• Introduction to R Markdown, Review of R commands (Notes)
• Introduction to Multivariate Analysis (Ch.1)
• Matrix Algebra, R Matrix Commands (Ch.2)
• Sample Geometry and Random Sampling (Ch.3)
• Multivariate Normal Distribution (Ch.4)
• MANOVA (Ch.6)
• Multiple Regression (Ch.7)
• Logistic Regression (Notes)
• Classification (Ch.11)

Curves in the plane and in space, global properties of curves and surfaces in three dimensions, the first fundamental form, curvature of surfaces, Gaussian curvature and the Gaussian map, geodesics, minimal surfaces, Gauss’ Theorem Egregium, The Codazzi and Gauss Equations, Covariant Differentiation, Parallel Translation.

MATH 3331 or MATH 3321 or equivalent, and three additional hours of 3000-4000 level Mathematics

*Ability to do computer assignments in FORTRAN, C, Matlab, Pascal, Mathematica or Maple.

This is an one semester course which introduces core areas of numerical analysis and scientific computing along with basic themes such as solving nonlinear equations, interpolation and splines fitting, curve fitting, numerical differentiation and integration, initial value problems of ordinary differential equations, direct methods for solving linear systems of equations, and finite-difference approximation to a two-points boundary value problem. This is an introductory course and will be a mix of mathematics and computing.

MATH 3331 or MATH 3321 or equivalent, and three additional hours of 3000-4000 level Mathematics 

*Ability to do computer assignments in FORTRAN, C, Matlab, Pascal, Mathematica or Maple.

This is an one semester course which introduces core areas of numerical analysis and scientific computing along with basic themes such as solving nonlinear equations, interpolation and splines fitting, curve fitting, numerical differentiation and integration, initial value problems of ordinary differential equations, direct methods for solving linear systems of equations, and finite-difference approximation to a two-points boundary value problem. This is an introductory course and will be a mix of mathematics and computing.

MATH 2318, or equivalent, and six additional hours of 3000-4000 level Mathematics.

Conditioning and stability of linear systems, matrix factorizations, direct and iterative methods for solving linear systems, computing eigenvalues and eigenvectors, introduction to linear and nonlinear optimization.

Catalog Description: Linear systems of equations, matrices, determinants, vector spaces and linear transformations, eigenvalues and eigenvectors.

Instructor's Description: The course covers the following topics: vector spaces, subspaces, linear combinations,systems of linear equations, linear dependence and linear independence, bases and dimension,linear transformations, null spaces, ranges, matrix rank, matrix inverse and invertibility,determinants and their properties, eigenvalues and eigenvectors, diagonalizability.

MATH 3330 and MATH 3336

Refer to the instructor's syllabus

Description: Divisibility theory, primes and their distribution, theory of congruences and application in security, integer representations, Fermat’s Little Theorem and Euler’s Theorem, primitive roots, quadratic reciprocity, and introduction to cryptography

MATH 3333 or consent of instructor

Graduate standing.

Instructor's notes

Linear Algebra Using MATLAB, Selected material from the text Linear Algebra and Differential Equations Using Matlab by Martin Golubitsky and Michael Dellnitz)
The text will made available to enrolled students free of charge.

Software: Scientific Note Book (SNB) 5.5  (available through MacKichan Software, http://www.mackichan.com/)

Syllabus: Chapter 1 (1.1, 1.3, 1.4), Chapter 2 (2.1-2.5), Chapter 3 (3.1-3.8), Chapter 4 (4.1-4.4), Chapter 5 (5.1-5.2, 5.4-5-6), Chapter 6 (6.1-6.4), Chapter 7 (7.1-7.4), Chapter 8 (8.1)

Project: Applications of linear algebra to demographics. To be completed by the end of the semester as part of the final.

Solving Linear Systems of Equations, Linear Maps and Matrix Algebra, Determinants and Eigenvalues, Vector Spaces, Linear Maps, Orthogonality, Symmetric Matrices, Spectral Theorem.

Students will also learn how to use the computer algebra portion of SNB for completing the project. 

Required Text: Abstract Algebra by David S. Dummit and Richard M. Foote, ISBN: 9780471433347

This book is encyclopedic with good examples and it is one of the few books that includes material for all of the four main topics we will cover: groups, rings, field, and modules.  While some students find it difficult to learn solely from this book, it does provide a nice resource to be used in parallel with class notes or other sources.

Catalog Prerequisite: Graduate standing, MATH 2331 and a minimum of 3 semester hours transformations, eigenvalues and eigenvectors.

Instructor's Prerequisite: MATH 2331, or equivalent, and a minimum of three semester hours of 3000-4000 level Mathematics.

Catalog Description: An expository paper or talk on a subject related to the course content is required.

Instructor's Description: The course covers the following topics: vector spaces, subspaces, linear combinations,systems of linear equations, linear dependence and linear independence, bases and dimension,linear transformations, null spaces, ranges, matrix rank, matrix inverse and invertibility,determinants and their properties, eigenvalues and eigenvectors, diagonalizability.

Graduate standing and MATH 3334.

In depth knowledge of Math 3325 and Math 3333 is required.

This first course in the sequence Math 4331-4332 provides a solid introduction to deeper properties of the real numbers, continuous functions, differentiability and integration needed for advanced study in mathematics, science and engineering. It is assumed that the student is familiar with the material of Math 3333, including an introduction to the real numbers, basic properties of continuous and differentiable functions on the real line, and an ability to do epsilon-delta proofs.

Topics: Open and closed sets, compact and connected sets, convergence of sequences, Cauchy sequences and completeness, properties of continuous functions, fixed points and the contraction mapping principle, differentiation and integration.

Existence and uniqueness theory in partial differential equations; generalized solutions and convergence of approximate solutions to partial differential systems.

This course introduces four main types of partial differential equations: parabolic, elliptic, hyperbolic and transport equations. The focus is on existence and uniqueness theory. Maximum principles and regularity of solutions will be considered. Other concepts that will be explored include weak formulations and weak solutions, distribution theory, fundamental solutions. The course will touch on applications and a brief introduction to numerical methods: finite differences, finite volume, and finite elements.

Catalog prerequisite: Graduate standing. MATH 4331.

Instructor's prerequisite: Graduate standing. MATH 4331 or consent of instructor

(Required) Topology, A First Course, J. R. Munkres, Second Edition, Prentice-Hall Publishers.

link to text

Catalog Description: Point-set topology: compactness, connectedness, quotient spaces, separation properties, Tychonoff’s theorem, the Urysohn lemma, Tietze’s theorem, and the characterization of separable metric spaces

Instructor's Description: Topology is a foundational pillar supporting the study of advanced mathematics. It is an elegant subject with deep links to algebra and analysis. We will study general topology as well as elements of algebraic topology (the fundamental group and homology theories).

Though traditionally viewed as a pure subject, algebraic topology has experienced a renaissance in recent years with the emergence of applied algebraic topology. To wit, SIAM has recently launched a new journal on applied algebra and geometry.

Recommended text: Reading assignments will be a set of selected chapters extracted from the following reference text:

• Introduction to Statistical Learning w/Applications in R, by James , Witten, Hastie, Tibshirani (This book is freely available online). ISBN: 9781461471370
• "Neural Networks with R” by G. Ciaburro. ISBN: 978-1788397872

Summary: A typical task of Machine Learning is to automatically classify observed "cases" or "individuals" into one of several "classes", on the basis of a fixed and possibly large number of features describing each "case". Machine Learning Algorithms (MLAs) implement computationally intensive algorithmic exploration of large set of observed cases. In supervised learning, adequate classification of cases is known for many training cases, and the MLA goal is to generate an accurate Automatic Classification of any new case. In unsupervised learning, no known classification of cases is provided, and the MLA goal is Automatic Clustering, which partitions the set of all cases into disjoint categories (discovered by the MLA).

Numerous MLAs have been developed and applied to images and faces identification, speech understanding, handwriting recognition, texts classification, stock prices anticipation, biomedical data in proteomics and genomics, Web traffic monitoring, etc.

This MSDSfall 2019 course will successively study :

1) Quick Review (Linear Algebra) : multi dimensional vectors, scalar products, matrices,  matrix eigenvectors and eigenvalues, matrix  diagonalization, positive definite matrices

2) Dimension Reduction for  Data Features : Principal Components Analysis (PCA)

3) Automatic Clustering of Data Sets by K-means algorithmics

3) Quick Reviev (Empirical Statistics) : Histograms, Quantiles, Means, Covariance Matrices

4) Computation of Data Features Discriminative Power

5) Automatic Classification by Support Vector Machines (SVMs)  

Emphasis will be on concrete algorithmic implementation and  testing on  actual data sets, as well as on  understanding importants  concepts.

Required Text: ”Neural Networks with R” by G. Ciaburro. ISBN: 9781788397872

• Required: Probability with Applications in Engineering, Science, and Technology, by Matthew A. Carlton and Jay L. Devore, 2014.
• Recommended: Introductory Statistics in R, Peter Dalgaard, 2nd ed., Springer, 2008
• Recommended: Introduction to Probability Models by Sheldon Axler 11th edition
• Lecture Notes

Course Description: Probability, independence, Markov property, Law of Large Numbers, major discrete and continuous distributions, joint distributions and conditional probability, models of convergence, and computational techniques based on the above.

Topics Covered: 

• Probability spaces, random variables, axioms of probability.
• Combinatorial analysis (sampling with, without replacement etc)
• Independence and the Markov property. Markov chains- stochastic processes, Markov property, first step analysis, transition probability matrices. Longterm behavior of Markov chains: communicating classes, transience/recurrence, criteria for transience/recurrence, random walks on the integers.
• Distribution of a random variable, distribution functions, probability density function. Independence.
• Strong law of large numbers and the central limit theorem.
• Major discrete distributions- Bernoulli, Binomial, Poisson, Geometric. Modeling with the major discrete distributions.
• Important continuous distributions- Normal, Exponential. Beta and Gamma.
• Jointly distributed random variables, joint distribution function, joint probability density function, marginal distribution.
• Conditional probability- Bayes theorem. Discrete conditional distributions, continuous conditional distributions, conditional expectations and conditional probabilities. Applications of conditional probability.

• Make sure to download R and RStudio (which can't be installed without R) before the course starts. Use the link RStudio download to download it from the mirror appropriate for your platform.
• **New: Rstudio is in the cloud: RStudio.cloud.

Graduate standing.

This course covers topics in analysis that are motivated by applications.

1. Review of metric spaces, completeness, characterization of compactness, extreme value theorem.
2. Contraction mappings and fixed points. Applications of contractions mappings: integral equations, solutions to initial value problems. Local existence and uniqueness of solutions, stability.
3. Lp spaces as metric completions. Extending the Riemann integral to Lp spaces. Banach spaces.
4. Dual spaces. Uniform boundedness.
5. Consequences of uniform boundedness for Fourier series and polynomial interpolation.
6. Uniform convexity, best approximation property and duality for Lp-spaces. Bounded inverse, closed graph theorem.
7. Hilbert spaces. Orthonormal bases and their characterization. Characterization of best approximation by orthogonal projection. Fourier series.
8. Convergence in L2 and pointwise convergence. Weak convergence.
9. Nonlinear best approximations and (approximate) sparsity.
10. Relationships between weak and norm convergence. Weak compactness in Hilbert spaces. Linear and convex programming in Hilbert spaces.
11. Operators and bilinear forms. The Lax-Milgram theorem.
12. Linear inverse problems. Sparse recovery by norm minimization.
13. The Hilbert-Schmidt norm and Hilbert-Schmidt operators. Compact self-adjoint operators. The spectral theorem for compact, self-adjoint operators.
14. Diagonalizing normal operators. Solutions to Schrodinger's eigenvalue problem and compact integral operators.
    Introduction to the Calculus of Variations.
15. Other topics in coordination with faculty.

Graduate standing and MATH 4331 and MATH 4377

Students are expected to have a good grounding in basic real analysis and linear algebra.

"Convex Optimization", Stephen Boyd, Lieven Vandenberghe, Cambridge University Press, ISBN: 9780521833783 (This text is available online. Speak to the instructor for more details)

Graduate Standing and must be in the MSDS Program.

Instructor prerequisites: The course is essentially self-contained. The necessary material from statistics and linear algebra is integrated into the course. Background in writing computer programs is preferred but not required.

• "Python for Data Analysis: Data Wrangling with Pandas, NumPy, and IPython", by Wes McKinney, 2 edition, 2017, O'Reilly. (PD) Paper Book. ISBN 13: 9781491957660. Available for free on Safari through UH library.

• "Python for Everybody (Exploring Data in Python3)",  by Dr. Charles Russell Severance, 2016, 1 edition, CreateSpace Independent Publishing Platform (PE) Paper Book. ISBN 13: 9781530051120

Instructor's Description: The course provides essential foundations of Python programming language for developing powerful and reusable data analysis models. The students will get hands-on training on writing programs to facilitate discoveries from data. The topics include data import/export, data types, control statements, functions, basic data processing, and data visualization.

Graduate standing and MATH 3334, MATH 3338 and MATH 4378. 

Instructor's prerequisite: main notions in undergraduate Probability and undergraduate Linear Algebra &familiarity with either Matlab or Python or R (no software initiation in this course)

Selected chapters in...
- An Intermediary Course in Probability Theory" by Allan Gut (any edition); free download
- A first course in probability" by Sheldon Ross

Basic Probability Concepts:

• Random Events and Probabilities on algebras of events,
• Independent Events and Conditional Probability,
• Borel-Cantelli lemma, Random variables ,
• Probability Distribution,
• Expectation,
• Variance,
• CDF,
• Moments,
• Quantiles
• Discrete Random Variables (examples): Binomial , Geometric, Poisson, ...
• Density functions (examples) : Exponential, Gaussian, Chi2, Weisbull, Beta, ...
• Random Vectors, Joint Probability Distribution, Joint Density , Marginal Density, Means, Covariances Matrices
• Multinomial distribution, Multivariate Gaussian distributions
• Law of Large Numbers, Central Limit theorem, Characteristic function
• Stochastic Modeling : Simulation of Large Random Samples and applications

• Markov Chains with finite state space, Transition matrix, Stationary distribution, Simulations
  • Applications : Hitting times , Gambler's Fortune

• Poisson processes for time indexed occurrences of specific events
  • Applications : Stochastic Dynamics of Bacterial Populations

Graduate standing. Math 6370-6371

"Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control" 2nd Edition, Steven L. Brunton and J. Nathan Kutz

Instructor's description: The goal of this class is to develop proficiency in implementing numerical methods in Python. In particular, this class will cover implementations of various numerical algorithms from Math 6370-6371 (Numerical Analysis) and more advanced topics from the book by Brunton and Kutz. Some topics might be taken out of Math 6374 (Numerical PDEs, but no finite elements) and Math 6366-6367 (Optimization). In addition, we might discuss deep learning and PyTorch if we have enough time and there is enough interest in the class.

The material will consist of two parts – covering more advanced Python topics (classes, modules, etc) and programming assignments implementing numerical methods. These two parts will be covered in parallel. A programming assignment will be given every 1-2 weeks. We will discuss the design of computational programs.

I will answer general questions about your code, but I will not discuss details about your code or how to debug your code. All programming assignments will be submitted via OneDrive using shared folders.

Grading – 75% homework, 25% final project, no exams

TBA

TBA

TBA

TBA

TBA

Walter Rudin, Functional Analysis, 2nd edition. McGraw Hill, 1991. (Instructor may suggest other tests or have their own typed notes)

Catalog description: Linear topological spaces, Banach and Hilbert spaces, duality, and spectral analysis.

Instructor's description: Topics covered in this first part of the course sequence include: Topological vector spaces; Completeness; Convexity; Spectral theory; etc. See Instructor's syllabus for more details.

TBA

Manifolds and tangent bundles, submanifolds and imbeddings, integral manifolds, triangulation of manifolds, connections and holonomy; Riemannian geometry, surface theory, Morse theory, and G-structures.

TBA

Manifolds and tangent bundles, submanifolds and imbeddings, integral manifolds, triangulation of manifolds, connections and holonomy; Riemannian geometry, surface theory, Morse theory, and G-structures.